Approved Fo 


#M? W° 7 - 


********************* 


MEMORANDUM FOR: Chairman, National Security Council Intelligence 

Committee 


SUBJECT: 


Consumer Participation in the National Intelligence 
Estimate Process 


1. At Tab A is a study, approved by the NSCIC Working Group, 
which proposes greater consumer involvement in^the National © 
Intelligence Estimate (NIE) and Special National Intelligence 
Estimate (SNIE) process by three steps: 

a. Submission of proposed NIE quarterly schedules to 
NSCIC members for approval and/or comment. 

b. -Participation by representatives of appropriate 
consumer organizations in the review of NIE and SNIE terms 
of reference, on invitation of the Director of National 
Estimates. 

c. Provision by NSCIC Working Group members who 

represent NSCIC principals of comments on each published 
NIE and SNIE by completion of evaluation forms. (Sample 
form is at Annex B of the study at Tab A.) I 

2. At Tab B is a memorandum which the NSCIC Working Group 
recommends be approved by the NSCIC and issued as guidance to the 
NSCIC member organizations. 


Bronson Tweedy 

Chairman, NSCIC Working Group 
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DRAFT 


SUBJECT: Consumer Participation in the NIE/SNIE Program 


PROBLEM 

1. To respond to the Presidential directive that the national 
intelligence product be improved by providing for increased 
involvement of high level consumers in the formulation of the 
National Intelligence Estimate (NIE) and Special National Intelligence 
Estimate (SNIE) programs and in the evaluation of the NIE and SNIE 
output. 


INTRODUCTION 

2. The President's memorandum of 5 November 1971, "Organization 
and Management of the U.S. Foreign Intelligence Community," and 
NSCID No. 1, "Basic Duties and Responsibilities," 17 February 1972, 
which called upon the Director of Central Intelligence to improve 

the "quality, scope and timeliness of the community's product", 
represent explicit criticism of the national) intelligence product, 
^-a-Hhocrgh-th e-f-ingei — Fs-no t-po-i-nt ed-spec-i -f-i ^a J-ly^-t-any-oar-tic uTar^ 
^ype^fH-n-t-e-l-l-4-gen c-e--p ubT-vea-t-io rr. < 1 

3. - Sin ce the NIE and SNIE documentsj^pep^sen^— fehe-primary 
ccmrrrtmTf^caoTTliTii^ — hntedii~ger rceTp n d s4®ge* these 
-estimates are intended for the use of high-level consumers, it appears 
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appropriate that attention be directed to exploration of, means by 
which the: NIE/SNIE program could be made more responsive to the 
needs of the policy making levels of the federal government. 

The proposals considered relate to three aspects of the NIE 
program and two aspects of the SNIE program: 

a. The input of NSC, State Department and Defense 
Department recommendations during development of the 
quarterly NIE production schedules. (There is no 
comparable scheduling program for the SNIEs.) 

b. The participation of offices not a part of the 
intelligence community in review of terms of reference for 
NIEs and SNIEs prior to start of the drafting process. 

c. The preparation of specific evaluations on 
individual NIEs and SNIEs by senior level customers. 

4. Since the National Security Council Intelligence Committee 
(NSCIC) was established to "give direction and guidance on national 
substantive intelligence needs and provide for a continuing evaluation 
of intelligence products from the viewpoint of the intelligence 
consumer," the following discussion of' the NIE and SNIE programs 
focuses on the manner in which the NSCIC and its subordinate body, 
the NSCIC Working Group, could be utilized. 


- 
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DISCUSSION 


Developing the NIE Program 


5. The NIE program is promulgated each quarter. The schedule 
is initiated by the Director of National Estimates and is concurred 
. in by the Board of National Estimates ( BNE)[af4er^^rrfewfl€e.s-w4^h 
re.p^s^fHta-t4ves-Trf 1 T^ducf4on^ t nn ^u hjeo-ts-arrd 

the-al Toeat>w^f— prodi^t-k>nH«esGurces^ The proposed schedule is 
disseminated to USIB representatives to give them an opportunity 
for review and conferences with their policy counterparts , if 
they choose to do so. The final program is submitted to the USIB 

and recommended by the Board to the Director of Central Intelligence 
for approval. 

6. Considerable variation occurs from quarter to quarter, but 
about half of theschedule entries areJ^S^es^^h^re-rei-s-Sijed- 
a£L^periodic^^2VJ(such as the NIEs on Soviet military capabilities); 
approximately one-fourth are estimates which are scheduled on the 
basis of a specific request via policy channels and about one-fourth 
are entered into the schedule on the initiative of the BNE in the 
expectation that the estimates will address problems to be faced by 
policy makers within the time frame of the document. 

7. Direct contact between intelligence and policy making levels 
takes place on occasion during development of the NIE schedule, but 
it is not regular or formalized. The Director of National Estimates 
has informally asked the Chief of the Net Assessment Group, NSC Staff, 
to serve as a funnel for input of NSC proposals concerning estimates. 
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Some Intelligence production personnel with geographic specialties 
maintain liaison with policy and operational offices involved with 
that same geographic area. The present system, however, does not 
provide for inputs from outside the intelligence community which 
explicitly indicate that top level officials personally have concurred in 
the proposed NIE schedule or have suggested deletions or additions of 

V 

specific subjects relating to their responsibilities. 

8. In order to provide a formal mechanism for regular inputs from 
the policy making levels and to provide the intelligence community 
with more direct indication as to the needs of top level consumers, it 
is proposed that the draft NIE schedule, as approved by the Director 
of National Estimates, be distributed to members of the NSCIC Working 
Group at the same time it goes to USIB representatives. Those Working 
Group representatives who represent NSCIC principals would be 
requested to arrange for provision of the comments and/or concurrence 
of their principals on each quarterly schedule to the Chairman , NSCIC 
Working Group, and to the Director of National Estimates. This would 
increase assurance that the BNE is working on NIEs which deal with 
problem areas identified as being of significance to the planning and 
decision making requirements of top level -consumers. These responses 
also would provide a channel for requests from the NSCIC principals 
for both NIEs and SNIEs. 

4 
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Participation by Non-USIB Agencies ' 
in Review of NIE/SNIE Terms of Reference 

9. At the present time, representatives of non-USIB organ- 
izations do not participate in the drafting of terms of reference 
for NIEs and SNIEs, or in the actual consideration of draft 
estimates during the process which leads to USIB consideration. 

10. There is growing recognition, however, that in some 

X 

areas the interests of non-USIB organizations are such that the 
intelligence product will be improved by the inclusion of 
representatives of non-USIB organizations. The expansion of 
participation by non-USIB agencies involved in international 
economic, financial and trade problems in activities of the 
USIB Economic Intelligence Committee is an illustration of this. 

11. It could well be that participation by personnel representing 
policy and operational levels of the NSC Staff, the Departments 

of State and Defense, or other federal agencies as appropriate, 
in the drafting and/or review of terms of reference for NIEs and 
SNIEs would improve the likelihood that the final estimate will 
be of optimum value to its principal users. 

12. Participation of representatives from policy levels of the 
government in the e-vo-Wt-f&n of a National • Intelligence Estimate might 
be considered to represent a distinct departure from the concept that 
there should be a complete separation of intelligence activities from 
policy considerations. On the other hand, such participation offers' at 
least the possibility of enhancing the likelihood that the estimate 
will include consideration of the questions on which intelligence 
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judgments will have a distinct bearing when the subject to which the 
estimate applies is being handled at the policy levels. The 
probability',, or even the chance, that such participation could result 
in improving the responsiveness of NIEs and SNIEs to the needs 
of top level consumers suggests that the effort should be made, at 
least on an experimental basis. 


13. It is proposed, therefore, that the NSCIC 


suggest | to the Director of Central Intelligence that the Director 

of National Estimates be requested to invite the participation of 

representatives from the NSC Staff, the Department of State, and the 

Department of Defense (or of other government agencies as 

appropriate) when he considers that the subject of the NIE or SNIE 

is one in which inputs to the terms of reference by personnel from 

outside the intelligence community would be useful. 

14. It is further proposed that the Director of National 

Estimates prepare an appraisal of the usefulness' of this procedure 

after a period of test and that he submit his comments and 

recommendations to the Director of Central. Intelligence as basis for 

A 

a DCI report to the NSCIC. 

Systematic Evaluation of NIEs and SNIEs 


15. A number of attempts have been made in the past two decades 
to elicit consumer evaluations of intelligence products. Most of 
such projects have involved the use of questionnaires sent to 
recipients of the various documents. In no cases have the results 
of general surveys been deemed adequate to provide direct basis for 

revision of a major production program. 
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16. At Annex A is a description of surveys which have been 

made of user reactions to National Intelligence Estimates. In 

quite marked contrast to the general surveys was the success 

achieved when the DCI in 1969 asked the Secretary of State, the 

Secretary of Defense and the Assistant to the President for 

National Security Affairs for their views or suggestions as to how 

\ 

NIEs on Soviet military subjects might be made "most useful" to them. 
(Pages A-5 - A-7 of Annex A describe this exchange.) This 
correspondence resulted in a major revision of the format of 

these NIEs and a marked expansion of the material included in the 
annexes. 

17. The success of this effort suggests that involvement of 
these same top level officials, or their representatives, in the 
evaluation of NIEs and SNIEs on a continuing basis would provide 
valuable inputs for the improvement of the national intelligence 
estimates process. 

18. Inasmuch as the NSCIC Working Group has been created to 
support the NSCIC in execution of its responsibi 1 i ty to provide 
substantive intelligence guidance to the intelligence community, it 
appears appropriate that the Working Group members be tasked with a 
responsibi 1 i t,y for providing feedback to the Working Group Chairman 
and to the Director of National Estimates on each NIE and SNIE which 
is published. It would be the responsibility of each Working Group 
member to arrange for obtaining comments on 

each NIE and SNIE from the consumers of primary interest within 
his organization. 
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19. Attached at Annex B is a copy of the questionnaire which 
would be used. It is proposed that the Chairman of the NSCIC 
Working Group forward a copy of each NIE and SNIE as it is 

published, along with the questionnaire, to those members of the , 

Working Group who represent NSCIC principals^ Those Working ^ 

Group members would be charged with furnishing the Chairman of 
the Working Group and the Director of National' Estimates with *V 

O— 

evaluations of each NIE and SNIE. 

20. Over a period of time these assembled comments should 
provide guidance to the Director of National Estimates as to how 
the various high level users of the NIEs and SNIEs, as represented 

/ 

on the NSCIC, consider the estimates could be improved in content, 
style, format and overall responsiveness to policy needs. These 
comments would provide a vehicle by which consumers who may be 
critical of the depth of analysis or of the approach used in a 
particular estimate can make these reactions known to those who 
are responsible for preparing estimates in that subject matter area. 


RECOMMENDATION 

21. It is recommended that the NSCIC Working Group approve 
the proposals contained in this study and that an appropriate action 
memorandum be submitted to the NSCIC. for approval and issuance as 
guidance to the Director of Central Intelligence and the NSCIC 
Working Group. 
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. - SURVEYS OF USER REACTIONS • ' 

TO NATIONAL INTELLIGENCE ESTIMATES 


1. The-e-xpansrem-of the U- S. intelligence community sine e-W-or-ki 
W-ar~ILLa.s-resuIteA,~- among. .other., things, in a marked increase- in the 
Q.utpnimf-intelligence-products - -estimates, serial publications, reports, 
bw4ieLi-ns-; — rrrdmTnrarnd-a T --eA3-v- ; — lAitrlj-— ■ ati p n p-Yi g f g in ' 

pr-edu-et-s— arne-addir-e'S-s-ed- a-nd— in-th-e-rtum-be-r—o-f-GC^pies 1 ^ 1 /^ 

v/- h i c k -a r-e — d-is-s- em-i-nat -ech — Be-eau-s-e-of-eone-e-m— as— to-\vhether— the~ri'gh.t 


r-esprorts-i'v«-tro~tli'e hh'6'd's~af-c-OTrs-umer s , various intelligence organizations 

i -i , A- '’**••*•*!.** *f - . . , . 


have conducted surveys" aLcme-ty-pe-or-anoth-ei— to -measure-consumer 
r era-et i o ns-,— u-s-ually -in-the-m tere-sLofobtaining coTHfflents which would 
provide basis for improvement of the product. The following paragraph^ 
describe the more important of such efforts relating to National Intelli- 
gence Estimates, and an assessment of the results achieved. 


2. Survey of 1955 

a. In February 1955 the Director of Central Intelligence asked 
the Board of National Estimates to conduct an informal survey of 
the use which consumers made of National Intelligence Estimates 
(NIE's). The survey, which was undertaken after four years 
experience with the national estimate system, was intended to shed 
light on (1) whether NIE's were circulated appropriately; (2) who, 
besides the National Security Council, werb the ultimate consumers; 
(3) how extensively NIE's were actually used by these consumers; 
and (4) the extent to which, as then written, the NIE's met^^^jsneeds. 

b. The survey was conducted in two stages. The first was a 
written questionnaire addressed to all offices and agencies receiving 
NIE's and intended to indicate NIE dissemination within each agency. 
The second stage was a series of interviews with a sample of policy- 
maker consumers to ascertain what use they actually made of NIE's. 
The survey was not intended to obtain opinions regarding the 
adequacy of NIE content or judgments on changes to make them 
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more useful.' ' The primary goal was to establish the distribution 
pattern of NIE's and to indicate the kinds of uses to which they 
were put. , , f 

. .. . [. 

c. The survey indicated that an average of 249^NIE‘ s' wer e 
distributed regularly to the White House, the NSC, the Operations 
Coordinating Board and the major departments and agencies with 
national security responsibilities. Many of these were further 
distributed to major commands and missions outside Washington. 


. d. Only a relatively few NIE's (selected by intelligence and 
screening officers) were seen by the President and department 
or agency heads, and in such ca)ses these top-level individuals 
usually read only the conclusions, briefs, or selected portions. 

The exceptions were most likely to be NIE's dealing with crisis 
situations requiring urgent and high-level policy decisions. 

NIE's were, however, found to be extensively read by second and 
third echelon officials in major departments and agencies and by 
various staffs responsible for national security planning and 
execution. It appeared that some NIE's did not reach all of the 
departmental policy or planning levels or other key officials who 
might have found them useful. In some cases, this appeared to 
result from failure of subordinates to pass the NIE's to their chiefs, 
and in others the criteria for distribution appeared to be overly 
restrictive. 



e. NIE's were found to be most generally used for background 
purposes, although some were used in working on specific planning 
and policy problems. The majority of users indicated that the 
format and problem coverage of NIE's were adequate, but many 
expressed dissatisfaction with particular NIE's. There were 
complaints that the NIE's were too long ..to be read in full by top- 
level individuals; they were said by some to be too general for 
'' detailed use in policy planning and execution; and some were said 
to be not relevant or sufficiently timely for use in consideration of 
specific policy problems. Overall importance of such complaints 
was not considered sufficient to warrant action to alter the format 
or content of NIE' s. Each Intelligence Advisory Committee * 
member was asked to reexamine the pattern of NIE distribution 
so as to improve the usefulness of NIE's to the policy, planning 
and executive branches of his agency. Each IAC agency was 

* Succeeded by the U. S. Intelligence Board on 15 September 1958 

‘ A- 2 ' i 
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requested to brief new key officials within its department on the 
nature of the NIE and the means at their disposal for requesting ' . 
NIE's responsive to specific intelligence problems they might have. 


Conference with the Assistant Secretary 
Planning (1957) 


of State for Polic\ 


The DCI, Director of National Estimates and his BNE members 
met on 25 July 1957 with Robert W. Bowie, Assistant Secretary of State 
for Policy Planning to discuss the form and content of the NIE program. 
Mr. Bowie's suggestions- to enhance the usefulness of NIE's to the 
policy planning process were as follows: v 

a. There was undue emphasis on precise statements of 
probability, with too little discussion of underlying factors. 

b. In many cases, it would be useful to discuss more 
possibilities, even if they had only a 20 percent chance of 
eventuating.' 

c. The estimate should show the degree to which predictions 
were based on evidence as opposed to judgment. 

d. Estimates should put more stress on the degree to which 
U. S. action could affect the predicted line of development, and 
what kinds of U. S. action could have impact. 

e. NIE's were not very readable, even on interesting 
subjects --the conclusions were "dehydrated" and lacked flavor. 

He also suggested that the IAC promulgate as "think pieces" a 
series of papers written by a single person or a small group (in 
the manner for Foreign Affairs articles), for consideration by 
policy-makers. •' 


4. Survey of NIE Distribution (1959-1960) 

a.. This survey effort had two aspects: (1) the circulation 
of a questionnaire enclosed in seven selected NIE's published 
during the period July 1959 to February I960 to obtain certain 
detailed information regarding the readership of NIE's, and 
(2) an inquiry to the distribution offices of the USIB agencies to 


Approved For Release 2002/10/10 : CIA-RDP80M01133A0009001 00007-2 


•- Approved For^ease 2002/10/10 : CIA-RDP80M011 




00900100007-2 


determine how NIE distribution is controlled.' 'The latter is hot 
relevant to the present study. The survey was undertaken to 
investigate the nature of and causes for an apparent large increase 
in NIE distribution from 250 in 1956; by I960 some 365 copies of 
NIE's were regularly being sent to recipients according to a 
standard distribution list, and about 85 more were held in reserve 
for special distribution. The survey ascertained that the substantial 
increase since 1956 was attributed to the following factors: \ ■ 

(1) Natural expansion of readership as the utility and 
significance of NIE's became more firrqly established 
throughout the government. 

(2) The growing number of senior officials who required 
NIE's in carrying out their responsibilities. 

(3) An increasing number of users in the intelligence 
. community itself. 

(4) The succession of world crises which generated 
increased interest in national intelligence on the part of 
commanders and planners. 

(5) A general increase in the number of people in the 

government concerned with the communist threat throughout 
the world, developments in modern technological warfare, 
and the capabilities and intentions of the Soviet Bloc. _ / 

(6) The addition of new readers overseas--political 
advisors, ambassadors, and military planners and commanders. 

(7) Agency reorganizations, including changes in locations 
of offices. 

(8) An increase in the size, responsibility, and complexity 
of agencies served by NIE' s. 

(9) The establishment or expansion of reference and 
library facilities in the USIB agencies. 


A- 4 ' 
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(10) An increase in the number of. NIE's released to 
foreign governments. (From about 26 to 45) 

(11) An apparent increase in readers whose need to know, 
might be marginal. 


b. An analysis of the returns from 636 respondents of the 
questionnaire addressed to NIE recipients indicated that about 
50 percent were engaged in intelligence, 19 percent had responsi- 
bilities in policy planning and coordination, and 8 percent were in 
operations. .Only 7 percentlisted themselves in the area of 
r es ear uu'Ynawevex 7 a subs tarltia.l-number of r eader s^"(3^ percent) 
indicated that they read only the NIE conclusions. The questionnair 
(^•t Tao 1) did not solicit ideas on how NIE’s might be improved. 

6. Queries to Secretaries of Defense and State re Soviet Military 
Estimates (1969) ~ 


■ ^ 
e 

ol-iv.SA-' 
i L. 


a. In November 1969 the DCI asked the Secretary of State, 
the Secretary of Defense, and the Assistant to the President for 
National Security Affairs for their views or suggestions as to how 
National Estimates on Soviet military subjects might be made 
"most useful" to them. Questions included: (1) is the division 
by subject (Strategic Attack, Strategic Defense, and General 
Purpose Forces) the best way of presenting the estimates; (2) is 
the amount of detail presented excessive and should there be 
different types of estimates for different readers; and (3) do existing 
procedures provide intelligence judgments of most vital interest, 
together with adequate evidence or argument, and are dissents 
presented adequately? 

b. The Secretary of State offered no "fundamental" criticism, 
but his suggestions for "refinements" were as follows: 

There could be "summary estimates" for the top 
. policy makers, more comprehensive than the 

"conclusions" sections of the then current estimates, 
but more condensed than the then current estimates. 
This would permit the basic NIE to be more detailed 
arid complete with a fuller presentation of the evidence. 
Annexes could provide background information on major 
issues, and there could be greater use of maps, charts 
and graphs. 


A - 5 
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"There should be a greater effort to evaluate Soviet 
doctrine and strategy together with discussion of the 
fundamental differences of opinion within the 
intelligence community. These could be incorporated 
in the "basic estimate" and this might obviate -the need 
to issue a separate NIE 11-4 as frequently as in the 
past. 

The "summary estimates" would be written after- the 

basic estimates were completed and would give an 

over -view of major Soviet weapons systems and 

describe significant changes in Soviet forces. They 

would also include a discussion of the general nature 

of Soviet military expenditures. The "summary ! 

estimates" for 11-3 "* and 11-8 should be j 

combined into a single paper so policy makers would - j 

have in one document an assessment of the main . . j 

elements of information on Soviet strategic forces j 

which have to be taken into consideration in calculating j 

the US-Soviet strategic balance. This would be useful, 

for example, in discussing US options for the SAL.T 

negotiations. 

I 

. . • I 

The estimates might contain a brief statistical j 

summary of US forces, including forward projections i 

drawn from the O SC FYDP, to give the reader a basis j I 

for comparing US and Soviet forces. 

c. The suggestions of the Secretary of Defense were as 
follows: 

Consideration should be given to relegating much of the 
detailed quantitative and qualitative analyses of 
. Soviet weaponry to appropriate appendices. This 

would leave in the main body of the . NIE only the 
more critical aspects of strategic weapons systems. 

The main body should also contain changes, dis- i 

agreements of the intelligence community, and levels 
of confidence inherent in the principal judgments. 

! 

.• i 

{ 

❖ "Main Trends in Soviet Military Policy" 

** "Soviet Strategic Air and Missile Defenses" / ; 

"Soviet Capabilities for Strategic Attack" , i 

A-6 " ' | 
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- '-' The estimates, especially the strategic attack and 
defense papers, should be revised and updated more 
often, perhaps quarterly. (The NIE on an annual 
basis was said to be of questionable usefulness a 
few months after its issuance. ) 

It would be useful to include five-year estimates in 
the NIE’s, perhaps less precise than the short-term 
estimates but more definitive than the ten-year trends 
of the then current estimates. 

Each NIE should have a section comparing major 
judgments of the previous NIE with the current 
judgment. Divergencies could be explained and 
tendencies to consistently over-estimate or under- 
estimate should be brought to the attention of the 
, .’•■■■ policy-maker so that he could determine the "hedge'' 

factor he must introduce in decisions regarding 
defense programming and planning. 

d. The change which both the Secretary of State and the 
Secretary of Defense recommended- -that a condensed statement of 
the principal findings of Soviet military estimates be prepared for 
the top policy-makers-- was adopted and NIE's on these subjects 
now have a lengthy summary and conclusions section at their 
beginning. Another suggestion of the Secretary of State was also 
adopted and resulted in a deeper probe of Soviet military strategy. 

NIE 11-4 (now "Issues and Options in Soviet Military Policy") has been 
retitled and considerably expanded in scope and depth. The Secretary 
of Defense's suggestion to include five-year estimates of Soviet 
force levels was also adopted, but in the form of several alternate 
projections for force levels, depending on assumptions as to the 
success of SALT talks, US alternate force levels, etc. 



The Board of National Estimates and its staff members 
conducted a series of meetings in 1970 with the staff of the Assistant 
to the President for National Security Affairs concerning the form and 
content of military Estimates. As a result of these meetings, a great 
deal more factual material was included in the estimates, together with 


A-7 
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an expanded discussion of the factors leading to the conclusions of the 
estimate. On 8 March 1971 the President commended the DCI and "the 
entire intelligence community" for NIE 11-8-70 which the-' President said 
was a considerable improvement over the previous version. He stated 
that he found particularly useful: 

"--The frequent sharply-defined, clearly argued 
discussions of the various contested issues. 


"--The attempt to incorporate a wide range of 

sources, such as clandestine reports and Soviet 
SALT statements. v 

"--The alternative force models based on explicit 
differences in underlying assumptions and the 
attempt to define which were the more likely 
models. 

"--The quantitative detail for each model which 
illustrates the differences between the models 
and gives an operational meaning to some of the 
general statements. " 
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CONSUMER EVALUATION OF NATIONAL INTELLIGENCE ESTIMATES (NIE) 
AND SPECIAL NATIONAL INTELLIGENCE ESTIMATES (SNIE) 


PURPOSE 


This evaluation is an element of the National Security Council 
Intelligence Committee (NSCIC) program intended to provide explicit 
feedback to intelligence producers from consumer users under arrange- 
ments sponsored by each NSCIC Working Group member in his department 
or agency. This evaluation should not be prepared by intelligence 
officers. What is sought is a non-intelligence user evaluation of 
an intelligence product. 


INSTRUCTIONS 


Evaluators are requested to complete this form within 30 days 
following publication of the NIE or SNIE. 


Security classification of the completed form will be based on 
the classification of the estimate being commented upon and 
classification of the comments included in the evaluation. 


The completed evaluation is to be forwarded to: 


D/DCI/IC 
Attn: PRG/IC 
Room 6 E 18 
CIA Headquarters 
Washington, D.C. 20505 
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\ W NSCIC ESTIMATE 

EVALUATION REPORT 


Identification of Estimate Evaluated 


(NIE) (SNIE) No. 

T i tl e 

Source of Evaluation 
Organization address: 


Contact: 


Estimate Utility and Timeliness 


Telephone 


1. Primary use to which estimate is being or will be put: 


a. Policy planning 

b. Operations planning 

c. Background information 


d. Military force planning_ 

e. Military R&D planning 

f. Other (specify) 


2. Utility of this estimate for ongoing or anticipated policy/operations 
problems: 


a. Absolute necessity 

b. Very useful 

c. Useful 


d. Nice to have 

e. Little or no use 


3. If some other source currently satisfies the need for this 

estimative information in an equal or better fashion, identify 
such source: 


Timeliness of the estimate: 


Very timely 


b. Timely 


Not timely 


If c. checked, how could timeliness have been improved? 
Why is estimate not considered timely? 


Approved For Release 2002/10/10 : CIA-RDP80M01133A0009001 00007-2 


'• Approved For^Jease 2002/10/10 : CIA-RDP80M01 13^3 


00900100007-2 


D. Scope and Format 

1. The scope and format of the estimate are: 
a. Excellent b. Satisfactory 


c. Unsatisfactory^ 


2. How could the scope and/or format of the estimate be improved? 
To support what uses? 


E. Factual Data 

1. For purposes of your organization, the degree to which 
factual data is presented is: 

a. Excessive b. Sufficient c. Not enough 

2. For what purposes would more or less detail improve the 

utility of the estimate? 

» 


F. Expression of Uncertainties 

1. The uncertainties relating to the data or the situations 
described are brought out: 

a. Excellently b. Satisfactorily c. Inadequately 

2. For purposes of your organization, the estimate treats the 
full range of uncertainties: 

a. Very well b. Adequately c. Inadequately 

3. How could the treatment of uncertainty be improved? 
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G. Expression of Alternatives 

1. For purposes of your organization, the range of alternative 
projections and the description of each alternative are: 

a. Quite comprehensive b. Adequate c. Inadequate 

2. How could the presentation of alternatives be improved? 


H. Quality of the Estimative Logic 

1. The extent to which the analysis logically ties together 
the factual and estimative elements of the paper is: 

a. Excellent b. Satisfactory c. Inadequate 

2. How might this aspect of the estimate be improved? 


i 


I. Overall Reaction to the Estimate 

(NOTE: The purpose of this section is to encourage you to summarize 
your reactions to the estimate and to present such additional comments 
as you consider useful as feedback to the intelligence community. If 
you have made hand-written notes on pages of the estimate itself which 
you consider would be of use to those who produced it, it would be 
appreciated if the estimate is returned with the evaluation form.) 

1. Which of the following words and phrases characterize this 
estimate: 

a. Exceptionally valuable d. Rehash of conventional 

b. Stimulating and persuasive wisdom 

c. Imaginative new viewpoint e. Shallow and unconvincing 

f. Dull 


- r 


3 
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MEMORANDUM FOR: Members of the National Security Council 

Intelligence Committee 

SUBJECT: Intelligence Consumer Participation in the 

NIE/ SNIE Program \ 


1. This memorandum implements NSCIC approval of proposals 

submitted by the JiSCIC Working Group aimed at increasing consumer 
td/JPww zazJE&I o#- 

involvement in^the National Intelligence Estimate (NIE) and 
Special National Intelligence Estimate (SNIE) process. These 
proposals respond to comments in the President's memorandum of 
5 November 1971 and the NSCID No. 1 of February 1972 which relate 
to improvement of intelligence production. 

2. To enable high level consumer comment on production 
schedules for NIEs, it is requested that the Director of Central 
Intelligence arrange to have copies of the draft quarterly NIE 
schedules distributed to members of the NSCIC Working Group 

at the same time the draft schedules go to USIB representatives. 
Those Working Group representatives who represent NSCIC principals 
are to arrange for provision of the comments and/or concurrence of 
their principals on each quarterly schedule to the Chairman, 

A 

NSCIC Working GroupQ and to the Director of National Estimates 
at CIA. 

3. It is recommended to the Director of Central Intelligence 
that he request the Director of National Estimates to invite 
comments by NSC staff members and non-intelligence representatives 


U u 


from the Department of State, the Department of Defense, and other 

ft 14t? D ^ a i 0M01 1 33A00090Q'i 4(&bofr3 < / 
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government agencies as appropriate on draft terms of reference 
for NIEs and SNIEs when he considers that inputs from outside 
the intelligence community would provide useful indication of 
the intelligence needs of customers for whom the estimate is 
being prepared. 

4. It is requested that the Chairman, NSCIC Working Group, 
arrange for distribution of a copy of each published NIE and SNIE 
to those Working Group members who represent NSCIC principals, 
along with a copy of the "Consumer Evaluation" questionnaire 
approved by the NSCIC. Those Working Group members who represent 
NSCIC principals are charged with furnishing the Chairman of 
the Working Group and the Director of National Estimates with 
filled-in evaluation forms and such other comments as are appropriate 
within 30 days of the publication date of the NIE or SNIE. 

Henry Kissinger 
Chairman, NSCIC 
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